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LONG-TERM  GOALS 

This  work  supports  mine  burial  prediction  by  the  US  Navy  by  transitioning  the  capabilities  provided 
by  state-of-the-art,  high-resolution  process  models  to  Naval  operations.  These  models  are  synthesized 
by  a  statistical  prediction  tool  (the  Mine  Burial  Expert  System — MBESM),  which  relates  uncertainty 
in  model  input  to  uncertainty  in  the  predicted  mine  burial.  This  work  will  produce  more  detailed  and 
more  accurate  mine  burial  predictions  and  corresponding  operational  risk  assessments. 

OBJECTIVES 

This  effort  will  facilitate  the  transition  of  the  MBESM  from  the  developers  (JHU/APL)  to  the  users 
(NAVO).  Specific  objectives  in  support  of  this  goal  include  (1)  evaluation  the  statistical  and 
numerical  implementation  of  the  MBESM;  (2)  development  of  an  objective  definition  of  mine  burial 
that  includes  a  useful  notion  of  risk;  (3)  development  of  a  meaningful  method  to  display  predictions  of 
mine  burial  and  risk;  (4)  implementation  of  mine  burial  predictions  over  a  map  region;  (5)  comparison 
MBESM  burial  predictions  to  corresponding  NAVO  prediction;  and  (6)  evaluation  the  predictive  skill 
of  the  MBESM  in  an  operational  setting 

APPROACH 

While  the  MBESM  is  ideally  suited  to  the  MBP  problem,  the  present  model  requires  further 
development  before  it  can  be  applied  in  the  NAVO  setting.  At  present,  the  MBESM  model  computes 
sensitivities  of  predicted  mine  burial  states  to  statistical  variation  in  the  inputs.  This  information  is  fed 
to  the  MBESM  through  synthetic,  Monte  Carlo  simulations  performed  by  Alan  Brandt  and  Sarah 
Rennie  at  JHU/APL.  The  resulting  prediction  is  a  probability  distribution  function  (PDF)  that  is 
information  rich,  yet  too  detailed  and  incompatible  with  NAVO’s  table  lookup  estimate,  which 
provides  a  one-value  prediction  for  each  realization.  Development  is  underway  that  to  enable  the 
MBESM  to  produce  the  requisite  risk  assessment. 

The  MBESM  model  originally  assumed  that  perfect  process-based  sub-models  and  perfect  PDFs  have 
been  used  to  provide  information  input.  Since  it  is  not  likely  that  the  sub-models  or  PDFs  are  perfect, 
ongoing  work  will  allow  the  MBESM  to  estimate  its  own  prediction  errors.  This  information  will  be 
obtained  from  the  process-based  sub-model  validation  studies  (work  conducted  by  JHU/APL)  and  by 
gaining  a  better  understanding  of  the  input  errors  associated  with  data  sets  available  to  NAVO  (work 
conducted  by  NRL). 
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At  present,  the  MBESM  has  “learned”  mine  burial  dynamics  from  a  particular  suite  of  training 
realizations.  Predictions  for  new  realizations  are  obtained  by  manually  entering  data.  Typical  NAVO 
operations  consist  of  up  to  1  m  resolution  over  several  km  map  regions,  yielding  perhaps  0(10  ) 
realizations.  The  present  MBESM  is  not  capable  of  generating  map  area  predictions  that  are 
compatible  with  NAVO  predictions.  The  MBESM  needs  to  be  modified  in  order  to  allow  direct 
comparison  with  existing  NAVO  methods  and  some  trial  map  regions  need  to  be  analyzed  and 
compared  to  typical  NAVO  predictions.  This  work  will  be  implemented  by  NRL. 

WORK  COMPLETED 

To  date  this  effort  has  achieved  the  following  accomplishments:  (1)  revision  of  the  Technology 
Transition  Agreement  between  NAVO  and  ONR;  (2)  review  and  modification  of  the  MBESM 
scientific  and  technical  implementation  details;  (3)  development  of  the  JAVA- API  interface;  (5) 
development  of  methodology  to  pass  known  sub-model  uncertainties  (i.e.,  errors  in  parameterizations 
of  physical  processes)  to  the  MBESM;  (6)  implementation  of  the  impact  burial  portion  of  the  MBESM 
using  data  supplied  by  NAVO;  and  (7)  comparison  the  MBESM  mine  burial  prediction  to  the 
corresponding  NAVO  Mine  Burial  Prediction. 

RESULTS 

To  be  operationally  useful,  the  MBESM  must  make  predictions  that  are  compatible  with  existing  Navy 
procedures.  The  predictions  under  the  current  doctrine  fall  into  one  of  five  categories  of  percent  mine 
case  burial:  0%,  1%-10%,  10%-20%,  20%-75%,  and  75%-100%.  The  variable  width  of  the  prediction 
categories  attempts  to  account  for  the  uncertainty  in  the  knowledge  used  to  make  the  prediction. 
However,  the  doctrinal  procedure  is  incapable  of  adapting  to  different  levels  of  input  uncertainty  and 
does  not  provide  a  method  for  balancing  the  associated  operational  risks.  Instead,  the  MBESM  can 
predict  probability  in  more  highly-resolved  burial  classes,  which  were  implemented  in  equally-spaced 
10%  intervals  (Figure  1). 


%  Area  Buried 


Figure  1.  Burial  probability  distribution  using  the  MBESM  impact  model. 

[PDF  indicates  that  the  burial  percentage  increases  as  the  risk  decreases.  The  predicted  mean 
burial  is  70%,  while  90%  burial  is  associated  with  5%  risk  (by;).] 
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In  operational  use,  a  risk  threshold  is  specified.  Then,  mine  burial  must  be  reported  in  a  manner 
consistent  with  the  risk.  We  define  risk  as  the  probability  that  a  mine  will  be  buried  more  than  b(a): 


and 


Prob.  [  burial  <  b(a)  ]  =  a 
Risk  =  1-a. 


(la) 

(lb) 


For  instance,  a  conservative  risk  might  be  a=95%,  indicating  that  the  prediction  is  allowed  to  fail  (i.e., 
burial  is  greater  than  predicted)  only  5%  of  the  time.  Figure  1  shows  an  example  where  the  MBESM 
was  run  with  a  single  set  of  inputs,  each  of  which  was  known  with  certainty  within  the  assigned  input 
bin  categories.  The  output  shows  the  probability  of  burial  for  each  of  10  possible  states.  The  example 
illustrates  that  even  when  the  inputs  are  known  with  high  certainty,  there  can  be  a  great  deal  of 
uncertainty  in  the  resulting  MBP  (which  is  due  to  model  sensitivity  to  small  variations  in  the  input). 

The  most  likely  burial  is  the  mean  value  (70%  burial  in  this  case),  but  there  is  significant  probability  of 
greater  burial.  The  prediction  that  allowed  5%  risk  was  one  of  90%  burial.  The  utility  in  coupling  risk 
and  burial  is  that  a  user  is  free  to  specify  the  risk  and  the  MBESM  result  is  interpreted  to  produce  a 
consistent  measure  of  burial. 


NAVO 

sediment -  ? 

class 


Shear  Strength 
PDF 


Figure  2.  Mapping  between  sediment  class  and  shear  strength  PDF 
[Schematic  diagram  shows  that  a  NA  VO  sediment  class  maps  to  a  particular  range 
of  sand-silt-clay  percentages  and  these  percentages  are  used  to  compute  a  shear 

strength  PDF] 


In  order  to  produce  burial  predictions,  probability  distributions  of  required  inputs  are  required.  This 
posed  a  particular  hardship  for  estimating  bed  shear  strength,  since  NAVO  databases  did  not  typically 
contain  this  information  directly.  This  problem  was  solved  by  assuming  that  the  bed  shear  strength 
could  be  estimated  if  the  sand  and  clay  content  of  sediments  were  known.  The  spatial  distribution  of 
sediment  type  was  available  from  standard  Navy  databases  (Figure  2),  and  the  sand/clay  content  of 
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these  classes  was  known.  An  empirical  formula  (equation  1)  converts  the  sand/clay  content  (csand,Cciay) 
to  a  distribution  of  shear  strengths,  based  on  a  log-normal  distribution: 


Su  =  ex  p[0-5o-Jexp[# 


sand  ^ sand 


+  PclayCclay  \ 


(2a) 


and 


=  (exp[2aln]-exp[aln])exp[2^sandcsand  +pclayeclay)] ' 


(2b) 


where  Su  and  asu  are  the  mean  and  standard  deviation  of  shear  strength,  ain  is  the  standard  deviation  of 
the  residuals  of  the  log-transformed  data,  and  pSand,Pciay  are  empirical  coefficients  describing  the 
dependence  of  shear  strength  on  sand/clay  content.  The  resulting  shear  strength  PDF  is  used  as  input 
to  the  MBESM. 


depth  (m)  sed.  cat. 


Figure  3.  Mapped  display  of  MBESM  inputs  (depth,  sediment  classification)  and  outputs 

(burial percentages  and  confidence). 

[There  is  a  50%  probability  of  exceeding  the  mapped  5  0th  percentile  burial  level.  ( E.g .,  in  the 
orange  region,  there  is  a  50%  probability  that  at  least  70%>  of  the  mine  case  will  be  buried.).  The 
confidence  interval  indicates  the  range  of  burial  that  encompasses  90%  of  the  probability.  (E.g.,  in 
the  region  with  no  sediment  data,  90%  of  burial  probability  is  spread  over  90%  of  all  burial  states.)] 


The  MBESM  was  applied  to  a  large  exercise  area  (Figure  3),  and  burial  associated  with,  in  this  case, 
50%  risk  were  computed.  The  spatial  structure  of  the  burial  map,  indicated  the  strong  dependence  of 
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burial  on  sediment  type.  Note  that  the  uncertainty  map  copes  with  regions  where  data  are  missing 
(indicating  that  the  entire  0-100%  burial  range  could  be  encountered  there).  Regions  with  large 
uncertainty  can  be  used  to  indicate  where  more  data  should  be  collected. 

IMPACT/APPLICATIONS 

This  work  demonstrates  that,  even  with  present,  sub-optimal  inputs,  the  MBESM  is  capable  of  making 
burial  predictions  that  are  consistent  with  Navy  operations.  In  order  to  achieve  this  goal,  the 
methodology  demonstrates  a  clear  impact  on  how  basic  research  results  and  data  collection  must  be 
treated  in  order  to  be  compatible  with  ANY  attempt  to  quantify  environment-dependent  operational 
risk.  First,  uncertainty  associated  with  model  errors  must  be  revealed  to  the  subsequent  statistical 
analyses.  In  this  case,  the  empirical  formulation  in  equation  2a  (a  prediction  of  shear  strength) 
required  the  corresponding  uncertainty  formulation  (equation  2b)  in  order  to  fully  specify  the  input 
uncertainty  as,  in  this  case,  a  log-normal  distribution.  Second,  uncertainty  associated  with  data  inputs 
must  be  retained.  In  our  case,  the  broad  range  of  actual  sediment  properties  (i.e.,  %sand,%clay) 
indicated  by  the  NAVO  classification  system  served  this  purpose. 

TRANSITIONS 

The  MBESM  (developed  by  JHU/APL)  and  associated  add-ons  developed  by  NRL  currently  run  on 
NRL  computing  systems.  The  purpose  of  this  arrangement  is  allow  NRL  to  emulate  NAVO’s 
operational  setting,  while  precluding  any  computational  burden  placed  on  NAVO.  Once  the  MBESM 
and  its  add-ons  are  fully  functional  at  NRL,  we  intend  to  physically  transitioned  the  software  to  NAVO 
computers. 
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